GEOMETRICALLY CORRECTING METHOD AND SYSTEM FOR IMAGE 
DISTORTION WITH THE AID OF AN AUXILIARY LINE 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention: 

The present invention relates to a method and system for 
correcting an image distortion occurring when an original image as captured 
or created is projected on a screen. 

2. Description of the Related Art: 

Due to a difference between a projecting method used to 
capture or create an original image and a projecting method used to project 
the original image in a planetarium, or when the image is projected onto a 
spherical screen, the image suffers from distortion. To reduce or eliminate 
this distortion of the projected image, JP-2002-1461 1 discloses a video 
projecting method which converts each pixel position on an original image 
to a position at which a projected image is less distorted or free from 
distortion to sequentially generate post-conversion pixel position data, 
sequentially generates projection image data for each frame after the pixel 
position conversion from input projection image data and post-conversion 
image position data, and emits a projected image from an output device, 
thereby correcting each pixel position on the original image when it was 
created to project the correct image. 

A means proposed for correcting such distortion of a projected 
image may project an auxiliary line from a projector onto a curved screen as 
a test pattern, and manipulate the auxiliary line displayed on a user interface 
display area on a display of a personal computer, while viewing the image of 
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the projected auxiliary line. 

Figs. 1 and 2 illustrate an example of correcting distortion of a 
projected image when it is projected onto cylindrically curved screen 1 1 by 
projector 12, wherein predetermined auxiliary line 14 is drawn on user 
5 interface screen 13a on a display of computer 18, and auxiliary line 14 is 
transformed on a display area defined for user interface screen 13a, on 
which auxiliary line 14 is displayed, to correct distortion of the projected 
image. Fig. 1 illustrates the image before the correction for distortion, while 
Fig. 2 illustrates the image after the correction for distortion. 

10 First, as illustrated in Fig. 1, a rectangle, for example, is 

displayed with straight auxiliary line 14 on the display area defined for user 
interface screen 13a. Auxiliary line 14 is projected onto cylindrically curved 
screen 1 1 from projector 12 through video cable 17. The auxiliary line 
projected onto curved screen 1 1 appears to be a distorted image due to the 

15 curved shape of screen 1 1 , rather than a rectangle composed of straight line 
segments, so that auxiliary line 14 displayed on the display area for user 
interface screen 13a is transformed or modified as illustrated in Fig. 2. 
Transformed auxiliary line 14 thus transformed is projected onto cylindrically 
curved screen 1 1 from projector 12 through video cable 17 to adjust the 

20 transformation of auxiliary line 14 on user interface screen 13a on display 13 
such that the projected image of the auxiliary line approaches to a rectangle 
composed of straight line segments. 

Then, when auxiliary line 14 projected onto curved screen 1 1 
fits to a rectangle composed of straight line segments, variables 

25 corresponding to transformed auxiliary line 14 at this time are saved as 

correction data. By correcting image data projected from projector 1 2 using 
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the correction data, a projected image can be geometrically corrected to 
display the projected image which has been corrected for distortion on 
curved screen 1 1 . 

The foregoing distortion correcting technique using auxiliary line 
5 14 can experience auxiliary line 14 extending out of the display area for user 
interface screen 13a as illustrated in Fig. 3 when a correction should be 
made beyond the display area for user interface screen 13a, or when the 
display of computer 18 has a resolution lower than that of projector 12. In 
this event, a problem arises in that the behavior of auxiliary line 14 cannot 

1 0 be confirmed out of the screen. 

Since a general-purpose personal computer is often used as 
computer 18, the resolution of projector 12 is not always the same as the 
resolution of the display associated with such a personal computer on which 
the user interface screen is displayed. For this reason, when projector 12 

15 has a higher resolution than that of the display of the personal computer, 
auxiliary line 14 must be corrected over an area beyond the display of the 
personal computer, causing auxiliary line 14 to extend out of the display area 
for user interface screen 13a. This would result in a failure in drawing 
auxiliary line 14 within the display area for user interface screen 13a, 

20 thereby making the correction for distortion more difficult. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a distortion 
correcting method and system which are capable of facilitating a geometrical 
25 correction of a distorted auxiliary line projected onto a screen by a projector, 
which correction is made on a user interface screen displayed on a display 
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of a personal computer, independently of the resolutions of the projector and 
the display. 

A method of geometrically correcting an image for distortion 
with the aid of an auxiliary line according to the present invention is adapted 
5 for a geometrical correction with the aid of an auxiliary line on a user 

interface screen, characterized in that a display area for the user interface 
screen is virtually displayed on a reduced scale through an application on a 
computer to define a virtual correction area therearound, so that a correction 
can be made for the auxiliary line which extends beyond the display area, 

10 and a correction can be made using the auxiliary line even when a used 
display has a resolution lower than that of the projector. 

In another aspect, a system for geometrically correcting a 
projected image for distortion according to the present invention includes a 
computer operated under the control of a program, a display connected to 

15 the computer for displaying a user interface screen thereon, a projector for 
projecting an image, and a screen for displaying thereon a video image 
emitted from the projector. An auxiliary line drawn by the computer is 
displayed on the display, and also projected onto the screen through the 
projector. The auxiliary line displayed on the screen is corrected for 

20 distortion by a predetermined transformation made by the computer to the 
auxiliary line displayed on the display. The system is characterized in that 
the computer has a function of virtually displaying a display area for the user 
interface screen on a reduced scale, and creating a virtual correction area 
therearound. 

25 The computer also has a function of displaying the auxiliary line 

on a reduced scale which may be implemented by a means for reducing the 
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display area for the user interface screen upon detecting that the auxiliary 
line drawn on the display extends beyond the display area for the user 
interface screen on the display, and creating a virtual correction area 
therearound. 

5 The computer further has a function of transforming the 

auxiliary line displayed on the display which may be implemented by a 
processing means for transforming the auxiliary line with a previously set 
approximate expression for correcting a projected image for distortion 
associated with the shape of the projection surface of the screen, and with a 

10 variable value applied to transform the approximate expression, wherein the 
projector may include an image processing function for transforming the 
auxiliary line emitted from the projector based on the result of the processing 
performed by the computer to project the transformed auxiliary line. 

The approximate expression for use in the correction may be, 

15 for example, an approximate equation of parabola for the horizontal direction 
of a cylindrical screen when it is employed; an approximate equation of 
parabola for the vertical and horizontal directions of a spherical projection 
surface when it is employed; an approximate equation of a straight line when 
an employed projection surface has flat walls with a corner therebetween; 

20 and a trigonometric function when an employed screen has a sinusoidally 
waved projection surface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 to 3 are explanatory diagrams illustrating an exemplary 
25 conventional method of geometrically correcting a projected image for 

distortion with the aid of an auxiliary line, to which the present invention is 
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applied; 

Fig. 4 is a schematic diagram generally illustrating a method of 
geometrically correcting a projected image for distortion with the aid of an 
auxiliary line according to one embodiment of the present invention; 
5 Fig. 5 is a block diagram illustrating an exemplary configuration 

of a computer and a projector in the embodiment of Fig. 4; 

Fig. 6 is a schematic diagram for describing the operation of the 

embodiment; 

Fig. 7 is a schematic diagram illustrating an example of a 
10 screen to which the present invention can be applied; and 

Fig. 8 is a schematic diagram illustrating another example of a 
screen to which the present invention can be applied. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
15 Fig. 4 is a schematic diagram generally illustrating a method of 

geometrically correcting a projected image for distortion with the aid of an 
auxiliary line according to one embodiment of the present invention. An 
illustrated system comprises curved screen 1; projector 2 for projecting an 
image; computer 8 for operational processing; and display 3 connected to 
20 computer 8 for displaying user interface screen 3a thereon. 

Curved screen 1 is shown as a cylindrically curved surface in 
Fig. 4, but the present invention can be directed to a screen which does not 
have a simple planar shape and therefore requires some geometrical 
correction, such as a spherical surface, walls with a corner therebetween, a 
25 curtain, and the like. 

Projector 2 and computer 8 are interconnected through 



6 



communication cable 6 which enables bi-directional communications 
therebetween or a one-way communication from computer 8 to projector 2 
for communicating information. Projector 2 and computer 8 are also 
interconnected through video cable 7, such that a video image created by 
5 computer 8 and displayed on display 3 can be projected onto curved screen 
1 by projector 2. 

Fig. 5 is a block diagram illustrating an exemplary configuration 
of computer 8 and projector 2. Computer 8 comprises simple input means 
21 such as a slide bar; and approximate expression calculating unit 22 which 

10 receives input values from input means 21 to calculate values for 

transformation using an approximate expression held therein. Projector 2 
in turn includes resolution converter 23 for image processing which is 
capable of scaling up or down an image; and an output device 24 for 
projecting the result of transformation. 

15 When the slide bar is manipulated by the user to move left or 

right, input means 21 responsively sets variables to values required for 
geometrical correction depending on a location to which input means 21 has 
been moved. Approximate expression calculating unit 22 holds an 
approximate expression for correcting distortion when an image is projected 

20 onto curved screen 1 , for example, equation of parabola for a cylindrically 
curved screen. 

Approximate expression calculating unit 22 substitutes values 
applied from input means 21 into variables in the approximate equation for 
correcting distortion, held therein, to calculate values for transformation of a 
25 shape and deliver a shape resulting from the correction, as well as resulting 
values. Resolution converter 23, which is capable of scaling up or down an 
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image, scales up or down the rectangular image based on the input from 
approximate expression calculating unit 22 to make a transformation 
conforming to the approximate expression. Output device 24 projects the 
result of the transformation made by resolution converter 23 onto the screen. 
5 Computer 8 also comprises a means for displaying auxiliary line 

4 on user interface screen 3a. Upon receipt of data from input means 21 , a 
parabola, a straight line, or the like is displayed on the screen as auxiliary 
line 4 for visually supporting the geometrical correction. The image 
including auxiliary line 4 displayed on display 3 is projected onto curved 
10 screen 1 by projector 2 through video cable 7, so that the operator makes a 
correction by transforming auxiliary line 4 on display 3 in the horizontal 
and/or vertical direction, while viewing the auxiliary line on the projected 
image to reflect the result of the correction to the image projected by 
projector 2. 

15 Computer 8 further comprises a means for communicating with 

projector 2 through communication cable 6 to capture information on the 
resolution of projector 2 from projector 2. In addition, computer 8 also 
comprises a means which permits the operator to select or enter an arbitrary 
resolution through a user interface to scale up or down user interface screen 

20 3a. 

Fig. 6 is a schematic diagram for describing the operation for 
scaling down the display area of user interface screen 3a in the foregoing 
embodiment. In the following, the operation of this embodiment will be 
described with reference to Figs. 4 to 6. As can be seen, the configuration 
25 of the system illustrated in Fig. 4 basically conforms to that of the 
conventional system illustrated in Figs. 1 and 2. 



Prior to a correcting operation, computer 8 captures information 
on the resolution of projector 2 from projector 2, or receives resolution 
information selected by the user. Subsequently, computer 8 draws user 
interface screen 3a in a one-to-one relationship to the resolution in 
5 accordance with the resolution information. As user interface screen 3a 
has been drawn, a correction can be started. 

Auxiliary line 4 in the form of a rectangle, for example, created 
on computer 8 is displayed on user interface screen 3a, and also projected 
onto curved screen 1 by projector 2. The auxiliary line projected on screen 

10 1 , however, does not appear as a rectangle but has upper and lower sides 
parabolically concaved as illustrated in Fig. 1. The user manipulates input 
means 21 to adjust real numbers to be substituted into variables of the 
approximate expression (here, an equation of parabola) held in computer 8 
to parabolically inflate the upper and lower sides of auxiliary line 4 displayed 

15 on user interface screen 3a. 

With this adjustment, auxiliary line 4 drawn on user interface 
screen 3a is transformed, and simultaneously projected onto curved screen 
1 by projector 2 through video cable 7, and a geometrical correction is made 
through video cable 7 to attempt to fit the auxiliary line in the image 

20 projected from projector 2 more to a straight line. 

By changing real numbers to be substituted into the variables of 
the approximate expression (here, an equation of parabola) held in computer 
8 for drawing auxiliary line 4, it is possible to correct an image for distortion 
when it is projected onto a variety of curved screens having different radii of 

25 curvature from one another. In this event, manipulations for transforming 
auxiliary line 4 can be carried out through a simple interface such as a slide 
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bar as illustrated in Fig. 5. 

In course of a correction of auxiliary line 4 on user interface 
screen 3a, if a correction made by the user spreads beyond the area of 
current user interface screen 3a to cause auxiliary line 4 to extend out of the 
screen of display 3 as illustrated in the left-hand figure of Fig. 6, resulting 
auxiliary line 4a will overlie on the outer peripheral line of the screen of 
display 3. In this event, as illustrated in the right-hand figure of Fig. 6, 
current user interface screen 3a is scaled down to reduced user interface 
screen 3b, and virtual correction area 5 may be created on the screen of 
display 3 around reduced user interface screen 3b, so that auxiliary line 4a, 
which has extended beyond the screen, can be displayed as auxiliary line 
4b. 

When display 3 connected to computer 8 has a resolution lower 
than that of projector 2, the current user interface screen may be scaled 
down likewise corresponding to the resolution, and virtual correction area 5 
is defined around the reduced user interface screen. In this way, a 
user-friendly geometrical correction can be carried out independently of the 
resolutions of projector 2 and display 3. 

In the foregoing embodiment described above, while the user 
interface screen is scaled up or down in response to the user's will, 
computer 8 can automatically scale up or down user interface screen 3a. 

For example, when a manipulation of input means 21 such as a 
slide bar shown in Fig. 5 causes a correction range for auxiliary line 4 to 
spread beyond the current user interface screen, computer 8 detects this 
situation, and automatically controls the resolution to scale down the size of 
the interface screen to create virtual correction area 5. On the other hand, 
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when the correction range falls within the user interface screen, computer 8 
detects this situation, and automatically controls the resolution to return the 
user interface screen to the original size. 

Alternatively, upon activation of a software program for 
5 geometrically correcting a projected image, computer 8 may capture 
information on the resolution of projector 2 from projector 2, and 
automatically determine an appropriate size for the user interface screen 
including a virtual correction area, suitable for the resolution. In this event, 
the user interface may be left for manually scaling up or down the user 

10 interface screen, so that the user can scale up or down the user interface 
screen at his discretion even after the automatic setting. 

Figs. 7, 8 illustrate other exemplary screens to which the 
present invention can be applied. Arrows drawn in the figures indicate 
directions in which the projector projects an image. While the foregoing 

15 embodiment employs a cylindrical screen as projection screen 1 , a screen 
directed by the present invention may be a screen in any shape, such as a 
spherical screen, a screen extending over two walls including a corner 
therebetween, a concave screen as illustrated in Fig. 7, or a sinusoidally 
waved screen, a screen extending over two walls including a corner 

20 therebetween with the left wall and right wall being in a different proportion, 
a screen including walls of a rectangular solid including corners 
therebetween, a wall-shaped screen having corners on the left and right 
sides, and the like, as illustrated in Fig. 8. 

In this event, a correction may be made using an approximate 

25 equation as mentioned above by changing variables included therein. For 
example, with a concave screen, a correction can be made by setting an 
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approximate equation which has characteristics opposite to those of a 
convex screen. With a screen composed of flat walls with a corner 
therebetween, a correction can be made using an equation of a straight line 
as an approximate equation. With a sinusoidally waved screen, a 
5 correction can be made by setting a trigonometric function as an 
approximate expression. 

While the foregoing embodiment has been described in 
connection with a transformation of the auxiliary line using an approximate 
equation which corresponds to a curved shape of a projection screen, the 

10 present invention can be applied to any device which comprises a memory 
for storing data on a proper auxiliary line such as a straight line or a circle, 
reads the auxiliary line from the memory for drawing on a user interface 
screen as well as for projection on a screen by a projector, transforms the 
auxiliary line drawn in the user interface screen if the auxiliary line projected 

15 onto the screen is distorted, adjusts the transformation such that the 
projected auxiliary line can be fitted to a desired auxiliary line such as a 
straight line or a circle, by way of example. 

The system according to the present invention can scale up or 
down the user interface screen in accordance with resolution information 

20 acquired from the projector, and can also scale up or down the user interface 
screen in accordance with resolution information selected or entered by the 
user, thus facilitating a geometrical correction using the auxiliary line 
independently of the resolutions of the projector and display. 
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